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FOR OFFICIAL USE ONLY 

Investigative Data War ehouse (TDW) Virtual Knowledge Base (VKR) 
Full Privacy Impact Assessment. MIOG 16-21 .5 


Executive Summary 


This full Privacy Impact Assessment (PIA) is submitted by the Information Resources Division 
in accordance with MIOG 1 6-2 1 .3 , Completing a Privacy Impact Assessment, and MIOG 1 6- 
21.5, Paragraphs A, B, C, and D. This assessment is intended to address MIOG requirements for 
the enterprise Investigative Data Warehouse (IDW) and Virtual Knowledge Base (VKB), and is 
submitted in coordination with Office of General Counsel for approval. 
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From: 

Sent: 

To: 

Cc: 

Subject: 


I (OGC) (FBI) 

I OGC1 (FBI) 

Wednesday, August 30, 2006 12:49 PM 
KELLEY, PATRICK W. (OGC) (FB I! 

t -ZZZlOGC) (FBI)j 
PGC) (FBI) 1 


(OGC) (FBI)C 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 



scopelpia.wpd (24 
KB) 


IDW2.pia.wpd (206 
KB) 


ALL INFORMATION CONTAINED 

HEREIN IS UNCLASSIFIED 

DATE 08-28-2007 BY 65179 dmh/bja/cal 


SARS database in IDW.SPT.wpd (229 
IDW.wpd (30 K... KB) 


ISPG approval IDW 
data sets2.w... 


FinCEN data for 
IDW.txt (6 KB)... 


1 










j: 

RE National 
Security Determina.. 



b7D 


THIS IS A PRIVILEGED COMMUNICATION AND IS NOT TO BE FURTHER DISSEMINATED WITHOUT PRIOR 
OGC APPROVAL. 


SENSITIVE BUT UNCLASSIFIED 
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JpGC) (FBI) 


From: 

Sent: 

To: 

Subject: 


](OGC) (FBI) 


WaHnacHau Aumict^n 2006 12:25 PM 

(OGC) (FBI); KELLEY, PATRICK W. (OGC) (FBI) 


RE: Central Record System 


UNCLASSIFIED 

NON-RECORD 


FYI. I just got a call tro d l at JMD about the article. Her Boss wanted to know which system notice covered 

IDW. I told her it is covered by CRS. Also explained that national security systems are exempt from E-Gov and that we 
had done several PIA looks at IDW, even though if s not required under the law. 

Original JMessaae 

’ Wednesday, August ^ OofSlS PM ALL IHF0RHATI0H CONTAINED 

KELLEY. PATRICK W. (OGC) (FBD HEREIN 15 UNCLASSIFIED 

| (OGC) (FBI) DATE 08-28-2007 BY 65179 dmh/bja/cal 

RE: Central Record System 

UNCLASSIFIED 
NON-RECORD 


From: 

Sent: 

To: 

Cc: 

Subject: 


Done. (Hope springs eternal.) 

I'm wit H | in view that if everyone I I starts running around with their hair on fire on this, they will just 

be pouring gas on something that quite possibly would just fade away if we just shrug it off. 

— Original Message 

From: KELLEY, PATRICK W. (OGC) (FBI) 

Sent: Wednesday. August 3 0. zoos 11:29 AM b6 

To: I I ( OGC) (FBI) b7C 

Cc: 1 I OGC) (FBI) 

Subject: Central Record System 

UNCLASSIFIED 

NON-RECORD 


Bill: can you send | | an electronic copy of the CRS Privacy Act System Notice. She is making noises about it. 
I'm hoping that after she reads it, she will be mollified. Thanks. 


UNCLASSIFIED 

UNCLASSIFIED 


UNCLASSIFIED 
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(OGC) (FBI) 


From: 

Sent: 

To: 

tOGC) (FBI) 

Thursday, September 07, 2006 8:32 AM 
KFI 1 FY PATRICK W (OGC) (FBI) 


b6 

Cc: 

1 lOGCloW 

|(OGC) (FBI) 

□ b7C 

Subject: 

1 1 (OGC) (FBI) 

FW: IDW PIAs 




ALL INFORMATION CONTAINED 

SENSITIVE BUT UNCLASSIFIED HEREIN 15 UNCLASSIFIED 

NON-RECORD DATE 08-28-2007 BY 6S179 dmti/b ja/cal 

1058805 


THIS IS A PRIVILEGED COMMUNICATION AND IS NOT TO BE FURTHER DISSEMINATED WITHOUT 
PRIOR OGC APPROVAL. 


— Original Message 


From: 

Sent: 

GRIGG, G. CLAYTON (CTO) (FBI) 




To: 

lOGO TFBI)I 1 

rrr5D)(FBi) 


be 

Cc: 

! PGC) (FBIj 

[(OGC) (FBI); 

|(OGC) (FBI); HARRINGTON/ T. J. 

b7C 

Subject: 

(tTD) (FBI) 
RE: IDW PIAs 





SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 

bS 


G. Clayton Grigg 


l 



Acting Director 

Foreign Terrorist Tracking Task Force (FTTTF) 
Counterterrorism Division (CTD) 
http://ctd.fyinet.fbi/IW/ 

(703) 553| Office) 

(202)1 

(877)1 

I nfbi.aov (Blackberry UNCLASS) 


be 

b7C 

b2 


— Original 

From: 

Sent: 

To: 

Cc: 

Subject: 


Message 

I t OGC) (FBI) 

Wednesday. Septembe r 06, 2006 2:53 PM 

I rrspifFBiv ortcc g a ayton ictd) (fbi) 

l(OGC) (FBI)J tOGC) (FBI)f 

'vzrmmiAs 1 1 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


JOGC) (FBI) 


b6 

b7C 



b5 


Original Message 

From: I I dTSDVFBn 

Sent: Wednesday. Sentemher 06. 7006 8:48 AM b6 

To: | |(OGC) (FBI)| ' |oGC) (FBI) b7C 

Subject: kb: 1UW PLAS 

SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


Thank you for taking care of this matter in my absence. 


202 } r 

1-877] [P) 

Public Internet e-mail ] B ic.fbi.gov 


Original Messaaa 

From: | 

Sent: 

T°L 


Subject: 


OGC) (FBI) 

Thursday, August 31, 2006 3:54 PM 

I OGC) (FBI); GRIGG, G. CLAYTON (CTD) (FBI)f 

(OGC) (FBO T " I fOGQ (FBI) j 

(ITSD) (FBI); AZMI, ZALMAI (DO) (FBI) 1 

RE: IDW PIAs 


;itsd)(fbi); kelley, Patrick w. 

OGC) (FBI); ISRAEL, JEROME W. 


b6 

b7C 

b2 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


b5 
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- — Original Mes sage 

From: I 

Sent: Wednesday, Augu st 30. 2006 4:35 PM 


UOGC) (FBI) 


To: GRIGG, G. ClAYTON (CTD ) (FBI)f 


(OGC) (FBl£ 


Subject: 


(ITSD) (FBI); AZMI, ZALMAI (DO) (FBI) 
IDWPIAs 


„ llTSD)(FBl£ 

lOGC) (FBI) | 


1 (OGC) (FBI); KELLEY, PATRICK W. 
_J(OGQ (FBI); ISRAEL, JEROME W. 


b6 

b7C 


SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


THIS IS A PRIVILEGED COMMUNICATION AND IS NOT TO BE FURTHER 

DISSEMINATED WITHOUT PRIOR OGC APPROVAL. 


SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 
SENSITIVE BUT UNCLASSIFIED 


3 




(Rev. 01-31-2003) 


FEDERAL BUREAU OF INVESTIGATION 


Precedence: ROUTINE 

To: Office of the CIO 

Counterterrorism 

Records Management 


Attn: 


Attn: 


Attn: 


Date: 03/25/2005 

CIO Zalmai Azmi 



AD Willie T. Hulon 
DAD Donald N. Van Duyn 
DAD T.J. Harrington 
A/U G. Clayton Grigg 
AD William L. Hooton 


From: 


Directorate of Intelligence 

Intelligence Issues Group / 1 R ? a 
Contact: SSaI 


1/202-324 


Approved By: 


Drafted By: 


Baginski Maureen A 
Solomon Jonathan I 


b6 
b7C 
b2 

ALL INFORMATION CONTAINED 

HEREIN 13 UNCLASSIFIED 

DATE 08-28-2007 BY 65179 dmh/bja/cal 


Case ID #: 66F-HQ-C1434337 (Pending) 

Title: ISPG APPROVAL OF REQUEST FOR 

INCLUSION OF ADDITIONAL DATA SETS 
IN IDW/SPT 

Synopsis: The Information Sharing Policy Group (ISPG) approves 

the immediate addition of seven (7) new data sets for inclusion 
in the Special Projects Team (SPT) accesses of the Investigative 
^J^ouse (IDW) . This data will support ongoing operational 
needs of the Counterterrorism Division (CTD) and all other IDW 
users . 

Reference: 66F-HQ-1321794 Serial 194 

Details: CTD has an operational need to apply the advanced 

features of the IDW system across a broader set of data. By 
adding these additional data sources, CTD will be able to uncover 
new criminal and terrorist links and activities. The enhanced 
results will contribute significantly to the FBI counterterrorism 


_ The ISPG has reviewed the data approval requests and 
ensured that all relevant Office of General Counsel (OGC) privacy 
impact assessments, interests of all operational divisions and 
specific records management issues have been addressed. The ISPG 


be 

b7C 


b6 

b7C 






Office of the CIO From: Directorate of Intelligence 

66F-HQ-C14343 37 , 03/25/2005 


approves the immediate addition of the following seven (7) data 
sets with appropriate updates for use in IDW/SPT. 


The above data sources are currently owned and licensed 
by CTD and used for CT work. Data quality and currency is not 
validated prior or during system loading. Newer editions of the 
sources will be loaded and the older editions will continue to be 





To: Office of the CIO From: Directorate of Intelligence 

Re: 66F-HQ-C1434337 , 03/25/2005 


part of the IDW/SPT analyses. Retention of older data permits 
retrospective analysis. 

Technical implementation may be either as an adjunct 
system accessible through IDW/SPT or as an integral part of the 
underlying, searchable federated data stores of IDW/SPT. This 
data approval does not obligate funds or resources for the 
technical activities that are required to implement and support 
system loading and related activities. 

Records Management Division (RMD) will provide guidance 
™/SPT concerning specific retention, disposal, and archiving 
for this data and the results of analysis derived from this data. 
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To: Office of the CIO From: Directorate of Intelligence 

Re: 66F-HQ-C1434337 , 03/25/2005 


LEAD (s) : 


Set Lead 1: (Action) 

RECORDS MANAGEMENT 

AT WASHINGTON . nr 

Pr ° v ide guidance to IDW/SPT concerning specific 
retention, disposal, and archiving for the data and results of 
analysis derived from the data. 

Set Lead 2: (Info) 

COUNTERTERRORISM 

AT WASHINGTON . Df 

Read and clear. 

Set Lead 3: (Info) 

DIRECTOR'S OFFICE 

AT CIO . DC 

Read and clear. 


♦♦ 
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THOMAS, MARCUS C. (OTD) (FBI) 


ALL INFORMATION CONTAINED 

HEREIN IS UNCLASSIFIED 

DATE 08-27-2007 BY 65179 BHH/BJA/CAL 

1058805 


Cc: 


IDivOO) (FBI) 


From: 

Sent: Thursday, April 29, 2004 2:14 PM 

To: 


P-y,fi.Q) (F|i)l 


SC 


(Div05) (FBI);f 


I'DivOOl (FB I)| 


1(NY) (FBI)C 


(FBlif 


I 




iDivOO) (FBI): I 


rDiv17HFBI) l~ 


/DivOO) (F BI):L 


FBI); 

, ] (DivOO) (FBI);[ , 

(FBI); BALD, GARY M. (Div13) (FB I); 1 
(DivOO) (FBI); | I DivOO) (FBI);| 


tDivOO) ( FBI): 

10i 




ivQI) (FBI) J 

(DivOO) (FBI)j 


DIVOO) (FBI);' 


[DivOO] 


DivOO) (F BI): f 


IDivOO) (FBI); L 


IDivOO) (FBI);!” 
~[Div05) (FBI)i 


IDivOO) (FBI): 


IDivOO) ( FBI): 
tDivl l) 


E 


] 


DivOO) (FBI); 


□ (DivOO) (FBI)| 

lDiv04) (F BI): BAILEY. GREGG D. (Div04) 
l-niunm /frivI 


] 


JONATHAN L iMM) (FBI) BER KIN JFFFRFY .1 miv l 1) (FBI); 
(FBI); WE IS, J P. (DIVOO) (FBI); |_ 


3 


( piv06) (HBI)J 


I 


Bl); 

(Div16) (FBI); SOLOMON, 
IDivOO) 


~tCK) (FBI): P I STOLE. JOHN S. (DivOO) (F BI) j I (DivO'5)'(FBI): 

II IfDivOO) (FBI): HA YNES. KER RY E. (ER ) (OGA); 


2 DivOO) (FBI);[ 


[DivOO) (FBI);! 


H.Div06) (FBI)C 


] 


(FBI);[ 


jf DivOO) (F BI); 


JPivOO) (FBI); 


[DivOO) (FBI) 


[DivOO) (FBI); QUIJAS, LOUIS F. (DivOO) (FBI); 

DivOO) (FBiy T D ivOO) 

T Piv06) (FBI);| | 


(FBDf 


(DivOO) (FBI)il 


tDiv06) (FBI): 


>0) (FBI); 


c 


(CK) (FBI); | 


1(0 M) (FBI): 


(DIV OO) (FBI).! 
(FBI)CI 


(DivOO) (FBI); DELANCER, MAXIMO M. 


[DivOO) (FBI)t 




(Div06^(F 


JUPINA. MICHELLE ANN (DivOO) 
I1(ER) (FBI); ! ' ' | 

IDivOO) (FBllI I 


(FBI); 

DivOO ): 


KELLEY, PATRIC K W. (Div09) (FBI)[ 


jDivOO) (FBI)C 


[Div17) (FBI);[ 


IDivOO) 


CK W. (Div09) (FBI) I I fDivIO) 

JDivOO) (FBI); COFFEY, ROBE RT CARL (DivOO) (FBI)J 


](Div10) (FBI);f 


(FBI); GARRITY, ROBERT J JR (Div171 (FBI):! 
ROBERT S. Ill (DivOO) (FBI)£ 


X 


](DivOO) ■. 

jjDivI 4) (FBI); MUELLER, 
JDivOO) (FBI); 


(DivOO) (FBI);| 

(FBI): BERE ZNAY. TIM OTHY D. (Div05) ( FBI): HARRIN GTON T J (hiv13) fFRI 


JDO Security Detai l: MARTINE Z. STEVEN 

pivOO) (FBI ! ID ivOO) 


~bivf)0) (FBI)| 


|(Div12) (FBI); 


£ 


(Div05) (FBI); | 


I 


rDivOO) (FBI); BOLL INGER, VIRGIN) 

(DivOO) (FB I) I fPivOO) (FBI): H OOTON. WILLIAM L. (Div17) (FBI); 

l(DivOO ) (FBI); ' 


. , JDivOO) (FBI); AZMI, ZALMAI (DivOO) (OGA); 

JMUELLER, ROBERT S. Ill (DivOO) (FBI); CASTOR, ANDREW J. (SA) (FBI) 


(DivQ4) (FBI)f 


(DivOO) (FBI);[_ 
](DivQ4)(FBI);l~ 


l(DiyOO) (FBI)C 


](IRD) (FBI); 


](Div04) (FBI);L 


l(Div04) (FBI); HOBSO N. PAMELA M. 

l(Div04) (FBI)i [Div04) (FBI); 


(Div04) (FBI); G EORGE. NICK L. (Piv04) (FB I)f 

!(Di 

(Div U4) (FBI):! 


lEBili 


~](Div04) (FBI)C 


(FB1)1 


!HHK3 


](Div04) (FBI); £ 


JJiv04) (FBI)[ 

j 

] (Div04) (FBljjf 


S(Div04) (FBI); JOLMA, LAWRENCE 
(Div04) (FBI); LUCC HESI, CARLO L ( DivQ 4 ) (FBI); 
Div04) (FBI):! 


(Div04) (FBI) 


P WERNER, JOHN J (Div04) (FRlT 
J (Div04) (FBI)! 


(Div04) (FBi)i 


043 (FBI 
~Piv04) 


J(Div04) (FBl£ 






JDiyQ4) 




]Div04) (f^BI); 


b6 

b7C 


b6 

b7C 


b6 

b7C 


b6 

b7C 


b6 

b7C 


10/27/2006 
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Page 3 of 3 


On January’ 25, 20 04, IDW 1 .0 was successfully deployed providing users with access to CT/CI 
ECF and UNI data, | [ Intel Plus file rooms. SAMNET. JICI scanned CT document s, open 

source news, and VGTOF using th d l and *>2 

retrieval tools. Training was deployed throughout the field for Field Intelligence Group b7 

personnel. To date, 485 accounts have been issued and CounterTerrorism Division has plans to 
request 4,200 accounts for members of the .Joint Terrorism Task Force members through the 
field. The IDW-Integration environment was established and is ready for final security testing. 


OTHER O/S 


OTHER O/S 


SENSITIVE but unclassified 


10/27/2006 
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UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse Integration System (IDW-I) 

System Security Plan 

.79 DMH/BJA/CAL . ^2 April 04 

Version 0.5 


Federal Bureau of Investigation 
Information Resources Division 
Data and Information Management Section 



Investigative Data Warehouse Integration 

System (IDW-I) 

System Security Plan 

Document Version 0.6 
22 April 04 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 





UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse Integration System (EDW-I) 

System Security Plan 
22 April 04 
Version 0.5 


©ssksso’ 

QEffikgSXMSE® 


ACS 

Electronic 
Case Files 
(ECF) 

FBI Automated 
Case System 
(ACS) 

Secret and below 

IntelPlus 

Filerooms 

FBI IntelPlus 

Secret and below 

SAMNet 

FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret and below 

VGTOF 

FBI National 
Crime Information 
Center (NCIC) 

SBU 

JICI 

FBI Records 
Management 
Division (RMD), 
Document 
Laboratory 
(DocLab), FBIHQ 

Secret and below 

Open 

Source 

News 

MiTAP 

Unclassified 



Table 3.5.1 IDW-I Data Sets 



-15- 

Outside the Scope 

UNCLASSIFIED // FOR OFFICIAL USE ONLY 
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Investigative Data Warehouse Integration System (IDW-I) 

System Security Plan 


03 NOV 04 
Version 1.0 


Federal 



ureauof 



STIGATION 


Information Resources Division 
Data and Information Management Section 



Investigative Data Warehouse Integration 

ALL INFORMATION CONTAINED 
HEREIN IS UNCLASSIFIED 
DATE 01-07-2003 BY 65179 BMH/BJA/CAL 

Document Version 1.0 
03 November 2004 


System (IDW-I) 
System Security Plan 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 
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Investigative Data Warehouse Integration System (IDW-I) 

System Security Plan 


03 NOV 04 
Version 1.0 


IkmuH 

HHRmH 

wmsm 


ACS 

Electronic 
Case Files 
(ECF) 

FBI Automated 
Case System 
(ACS) 

Secret and below 


InteiPlus 

Filerooms 

FBI InteiPlus 

Secret and below 


SAMNet 

FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret and below 


VGTOF 

FBI National 
Crime Information 
Center (NCIC) 

SBU 


JICI 

FBI Records 
Management 
Division (RMD), 
Document 
Laboratory 
(DocLab), FBIHQ 

Secret and below 


Open 

Source 

News 

MiTAP 

Unclassified 



Table 3.5.1 IDW-I Data Sets 


-15- 


fa 2 
b7E 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 












UNCLASSIFIED//FOR OFFICIAL USE ONLY 



EDERAL 



UREAU OF 


I 


NVESTIGATION 


Office of the Program Management Executive 



Security Concept of Operations (S-CONOPS) 
Investigative Data Warehouse (IDW) Program 


Document Version 1.2 
November 29, 2004 


i 

UNCLASSIFIED//FOR OFFICIAL USE ONLY 


UNCLASSIFIED//FOR OFFICIAL USE ONLY 


Outside the Scope 


The table below lists the data and sources for the Operational Subsystem. 



b2 

blE 


b2 

b7E 
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UNCLASSIFIED//FOR OFFICIAL USE ONLY 




UNCLASSIFIED//FOR OFFICIAL USE ONLY 


’Outside the Scope 



2.3.2 Special Projects Team (SPT) Subsystem 

The Special Projects Team (SPT) Subsystem allows for the rapid import of new specialized 
data sources. These data sources are not made available to the general IDW users but instead are 
provided to a small group of users who have a demonstrated “need-to-know”. The SPT System 
is similar in function to the IDW-S system, with the main difference is a different set of data 
sources. The SPT System allows it’s users to access not only the standard IDW Data Store but 
the specialized SPT Data Store. 

The table below lists the data and sources for the SPT Subsystem. 
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SCOPE V2. 0/ID W VI. 0 Data Sets 

ACS ECF (CT Case Files): 

♦ ASCII flat files (metadata and document text) and WordPerfect (document) binaries 

♦ i ; 

♦ Data is synchronized once a day, which includes processing of adds, deletes, and modifications 

Intelplus (CT Filerooms): 

♦ Scanned TIFF images and OCR’ed ASCII text documents 

♦ | 

♦ Data is synchronized once a week, which includes processing of adds, deletes, and modifications 

SAMnet: 

♦ ASCn files in standard cable traffic message format (all cap itals with specific header) 

♦ | 

♦ SAMNET data is provided/updated three times a day b2 

JICI: b7E 

♦ Scanned TIFF images and OCR’ed ASCII text (pages) 

♦ f 

♦ Static file system 

VGTOF: 

♦ ASCn flat files (data/metadata, one row per subject) and JPEG im age binaries (none, one, or multiple per subject) 

♦ 

♦ At present, updated file being provided in its entirety on a weekly basis 

Open Source: 

♦ The Open Source Library is collected from global news sources that are either in English or have been translated 

into English 

♦1 - 

♦ The Open Source Library is updated once a day 
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Investigative Data Warehouse (ID 
System Security Plan 


- Secret 


INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse (IDW-S) is an 
initial data warehouse, content management and data mining system that will permit FBI 
investigative, analytical, administrative and intelligence personnel to access aggregated 
data previously only available through individual applications. The IDW-S system will be 
authorized to process classified national security data up to, and including, Secret. The 
IDW-S system is the successor of the Secure Counter-Terrorism/Collaboration Operational 
Prototype Environment (SCOPE”). 



Outside the Scope 


Data processed by the system will include the following data sets: 

• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation 
(JICI) defined archived documents; 
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• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the 
Criminal Justice Information Systems (CJIS) Division; 

• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open 
Source Data 


Outside the Scope 
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3.5.3 SAMNet 

The Secure Automated Messaging Network (SAMNet) data source consists of cab le 
traffic messages received by the FBlj 

| SAMNet provides only ADD record 

types, and SAMNet data is updated in IDW-S three times a day. SAMNet data is 


3.5.4 VGTOF 

Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI 
National Crime Information Center (NCIC). VGTOF data includes two 
components: Data/metadata for each named individual/offender and potentially 
multiple JPEG images per individual.! 


b2 

b7E 


b2 

b7E 


b2 

b7E 
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3.5.5 JICI 

The Joint Intelligence Committee Investigation (JICI) data collection was created following 
the September 1 1 attacks. Paper counter-terrorism files/folders from all FBI Field Offices 


is not updated./ 


I JICI is a static collection that 


3.5.6 Open Source News 

The IDW-S VI. 0 system contains an Open Source News library collected by the 
DARPA TIDES Program. These are primarily news source from around the world 
that are either in English or have been translated into English. Op en Source News 
data is re ceived in the form of text files (one per news article) and ! 

I I f he Open Source News data goes into IDW-S once a day. Open Source 

News dauj 

Open Source News material is derived from the following sources: 

Addis Ababa Tribune - http://www.addistribune.com/ 

Agencia Brasilia - http://www.radiobras.gov.br/ 

Al-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 

AllAfrica.com - http://allafrica.com/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - http://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://www.atimes.com/ 

Bangkok Post - http://www.bangkokpost.net/ 

.Christian Science Monitor - http://www.csmonitor.com/ 

Crescent International - http://www.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - http://www.debka.com 

East Africa Daily Nation - www.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - http://www.haaretzdaily.com/ 

| IFRC international Federation of the Red Qgss - http://www.ifrc.org/ 

IRIN Integrated Regional Information Network - http://www.irinnews.org/ 

Iraq Press News Agency - http://www.iraqpress.org/ 


1 Deleted: Intonation 
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Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://www.thejakartapost.com/ 

Janes - httpWwww.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L'Osservatore Romano - www.vatican.va/news_services/or/or_eng/texthtml 
Lagos (Nigeria) Guardian - http://www.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://www.nation.com.pk/ 

Lebanon Daily Star (Beirut) - http://www.daiIystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://www.mb.com.ph/ 

Manila Times - http://www.manilatimes.net/ 

Miami Herald - http://www.miami.com/ 

Moscow Times - http://www.themoscowtimes.com/ 

National Post and CP - http://www.canada.com/ 

New Straits Times (Kuala Lumpur) - http://www.emedia.com.my/Current_News/NST/ 
PETRA (Jordanian News Agency) - http://www.petra.gov.jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://www.philstar.com/phiistar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://www.therussianissues.com/ 

Russian Observer - http://www.russianobserver.com/ 

SABA (The News Agency of Yemen) - http://www.sabanews.gov.ye 
Saudi Gazette - http://www.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://www.dispatch.co.za/ 

Sydney Morning Herald - http://www.smh.com.au 
Tehran Times - http://www.tehrantimes.com/ 

Times of India - http://timesofindia.indiatimes.com/cms.dll 
UNHCR UN High Commissioner on Refugees - http://www.unhcr.ch/ 

Ummah News - http://www.ummahnews.com/ 

Uzbekistan Report - http://www.uzreport.com/eng/ 

Washington Post - http://www.washingtonpost.com/ 

XinHua News Service - http://www.xinhuanet.com/english/ 

Yemen Times (weekly) - http://www.yementimes.com/ 

Yomiuri Shimbun (Japan) - http://www.yomiuri.co.jp/ 
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Data processed by the system will include the following data sets: outside the scope 


• Approved case files from the FBI’s Automated Case Support (ACS) case management 
system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) defined 
archived documents; 

• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPlus File Rooms; and 
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Violent Gang and Terrorist Organization File (VGTOF”) from the Criminal Justice 
Information Systems (CJIS) Division; 

Defense Advanced Research Projects Agency (DARPA) Translingual Information 
Detection, Extraction and Summarization (TIDES) Onen Source Data 
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INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse (IDW-S) is an initial 
data warehouse, content management and data mining system that will permit FBI investigative, 
analytical, administrative and intelligence personnel to access aggregated data previously only 
available through individual applications. The IDW-S system will be authorized to process 
classified national security data up to, and including, Secret The IDW-S system is the successor 



Data processed by the system will include the following data sets: 


• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) 
defined archived documents; 

• Secure Automated Messaging Network (SAMNet) message traffic; 


Outside the Scope 
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• IntelPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the Criminal 
Justice Information Systems (CJIS) Division; 

• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open Source 
Data 


Outside the Scope 
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• Automated Case Support (ACS) System, Electronic Case File (ECF) Subsystem 
[Secret and below] 

• IntelPlus [Secret and below] 

• Secure Automated Message Network - Secret (SAMNet-S) [Secret and below] 

• NCIC Violent Gang and Terrorist Offender File (VGTOF) [Sensitive But 
Unclassified] 

• Joint Intelligence Committee Investigation (JICI) [Secret and below] 

• DARP A/TIDES Open Source News [Unclassified] 

Data from each source is held in an identified source Library against which users can direct the 
analytical tools. 


Data Ingest 



Received data is parsed into individual serial records (in the case of ACS 
ECF), documents (IntelPlus, JICI, Open Source News), messages (SAMNet), 
or files (VGTOF). 
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have been officially sanctioned for inclusion in IDW. For each such serial, the ECF data includes 
metadata and text IDW-S is synchronized against the ECF system once a day, a process which 
consists of receiving and processing the previous day’s increment of ADD, MOD, and DELETE 
records/ 1 ' " 


3.5.2 IntelPIus 

EDW-S currently contains several IntelPIus counter-terrorism (CT) Fiierooms: 


Outside the Scope 



3.5.3 SAMNet 

The Secure Automated Messa ging Network (SAMNet) data source consists of cable traffic 
messages received by the FBlf 


| | SAMNet provides o nly ADD record types, and SAMNet data is updated in IDW-S three 

times a day. SAMNet data id I 
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3.5.4 VGTOF 

Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI National Crime 
Information Center (NCIC). VGTOF data includes two components: Data/meta data for each 
named individual/offender and potentially multiple JPEG images per individual \ 


3.5.5 JICI 

The Joint Intelligence Committee Investigation (JICI) data collection was created following the 
September 1 1 attacks. Paper counter-terrorism files/folders from all FBI Field Officesl 


I JICI is a static collection that is not updated.^ 


3.5.6 Open Source News 

The IDW-S V1.0 system contains an Open Source News library collected by the DARPA TIDES 
Program. These are primarily news source from around the world that are either in English or 
have been translated into English. Open Source News data is received in the form of text files 
(one per news article) an d hflie Open Source News data goes into IDW-S 

once a day. Open Source News dat ^ | 

Open Source News material is derived from the following sources: 

Addis Ababa Tribune - http://www.addistribune.com/ 

Agencia Brasilia - http://www.radiobras.gov.br/ 

Al-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 

AllAffica.com - http://allafrica.com/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - http://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://www.atimes.com/ 

Bangkok Post - http://www.bangkokpost.net/ 

Christian Science Monitor - http://www.csmonitor.com/ 


-23- 

UNCLAS S I FI E D // FOR OFFICIAL USE ONLY 


b2 

b7E 




UNCLASSIFIED // FOR OFFICIAL USE ONLY 


Investigative Data Warehouse (IDW) - Secret 
System Security Plan 
5_December2003 

Version 0.7 

Crescent International - http://www.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http V/news .tele graph. co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - http://www.debka.com 

East Africa Daily Nation - www.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - http://www.haaretzdaily.com/ 

IFRC International Federation of the Red Cross - http://www.ifrc.org/ 

IRIN Integrated Regional Information Network - http://www.irinnews.org/ 

Iraq Press News Agency - http://www.iraqpress.org/ 

Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://www.thejakartapost.com/ 

Janes - http://www.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L'Osservatore Romano - www.vatican.va/news_services/or/or_eng/text.html 
Lagos (Nigeria) Guardian - http://www.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://www.nation.com.pk/ 

Lebanon Daily Star (Beirut) - http://www.dailystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://www.mb.com.ph/ 

Manila Times - http://www.manilatimes.net/ 

Miami Herald - http://www.miami.com/ 

Moscow Times - http://www.themoscowtimes.com/ 

National Post and CP - http://www.canada.com/ 

New Straits Times (Kuala Lumpur) - http://www.emedia.com.my/Current_News/NST/ 

PETRA (Jordanian News Agency) - http://www.petra.gov.jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://www.philstar.com/philstar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://www.therussianissues.com/ 

Russian Observer - http://www.russianobserver.com/ 

SABA (The News Agency of Yemen) - http://www.sabanews.gov.ye 
Saudi Gazette - http://www.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://www.dispatch.co.za/ 

Sydney Moming Herald - http://www.smh.com.au 
Tehran Times - http://www.tehrantimes.com/ 

Times of India - http://timesofindia.indiatimes.com/cms.dll 

UNHCR UN High Commissioner on Refiigees - http://www.unhcr.ch/ 
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Ummah News - http://www.ununahnews.com/ 

Uzbekistan Report - http://www.uzreport.com/eng/ 
Washington Post - http://www.washingtonpost.com/ 
XinHua News Service - http://www.xinhuanet.com/english/ 
Yemen Times (weekly) - http://www.yementimes.com/ 
Yomiuri Shimbun (Japan) - http://www.yomiuri.co.jp/ 

3.5.7 Summary of Data Sources 
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3.9.9 Indirect Connections 

IDW-S connects to the following sources of data: 
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INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse Secret System (EDW- 
S) is an initial data warehouse, content management and data mining system that will permit FBI 
investigative, analytical, administrative and intelligence personnel to access aggregated data 
previously only available through individual applications. The IDW-S system will be authorized 
to process classified national security data up to, and including, Secret The EDW-S system is the 
successor to the Secure Collaboration Operational Prototype Environment (SCOPE), which 
originally was named the Secure Counter-Terrorism Operational Prototype Environment. 



Data processed by the system will include the following data sets: 

• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 
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♦ Electronic versions of the Joint Intelligence Committee Investigation (JICI) 
defined archived documents; 
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• Secure Automated Messaging Network (SAMNet) message traffic; 

• InteiPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the Criminal 
Justice Information Systems (CJIS) Division; 

• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open Source 
Data 
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3.5. Data Processed 


IDW-S processes data from the followine data sources, with the security classification of the 





TRANSFER 
DATA SOURCE METHOD 


ACS 

Electronic 
Case Files 
(ECF) 


FBI Automated 
Case System 
(ACS) 


IntelPlus 

Filerooms 


FBI IntelPlus 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 









UNCLASSIFIED // FOR OFFICIAL USE ONLY 


Investigative Data Warehouse (IDW) - Secret 
System Security Plan 
08 January 04 


■ Version 0.9 



3.5.1 ACSECF 

IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the Automated Case 
System (ACS). This subset consists of serials in those case classifications/sub classifications that 
have been officially sanctioned for inclusion in IDW-S. For each such serial, the ECF data 
includes metadata and text. IDW-S is synchronized against the ECF system once a day, a process 
which consists of receiving and processing the previous day’s increment of ADD. MOD, and 
DELETE records! i 


3.5.2 IntelPlus 

IDW-S currently contains several IntelPlus counter-terrorism (CT) Filerooms: 
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3.5.3 SAMNet 



Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI National Crime 
Information Center (NCIC). VGTOF data includes two components: Data/metadata for each 



3.5.5 JICI 
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I JICI is a static collection that is not updatedL I 

3.5.6 Open Source News 

The DDW-S VI .0 system contains an Open Source News library collected by the DARPA TIDES 
Program. These are primarily news source from around the world that are either in English or 
have been translated into English. Open Source News data is received in the form of text files 
(one per news articl 4 1 The Open Source News data goes into IDW-S 

once a day. Open Source News datd I 
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Open Source News material is derived from the following sources: 

Addis Ababa Tribune - htfp://www.addistribune.com/ 

Agencia Brasilia - http://www.radiobras.gov.br/ 

Al-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 
AllAfrica.com - http://allafiica.com/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - http://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://www.atimes.com/ 

Bangkok Post - http://www.bangkokpost.net/ 

Christian Science Monitor - http://www.csmonitor.com/ 

Crescent International - http://www.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - http://www.debka.com 

East Africa Daily Nation - www.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - http://www.haaret2daily.com/ 

IFRC International Federation of the Red Cross - http://www.ifrc.org/ 

IRIN Integrated Regional Information Network - http://www.irinnews.org/ 

Iraq Press News Agency - http://www.iraqpress.org/ 

Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://www.thejakartapost.com/ 

Janes - http://www.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L'Osservatore Romano - www.vatican.va/news_services/or/or_eng/text.html 
Lagos (Nigeria) Guardian - http://www.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://www.nation.com.pk/ 

Lebanon Daily Star (Beirut) - http://www.dailystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://www.mb.com.ph/ 

Manila Times - http://www.manilatimes.net/ 

Miami Herald - http://www.miami.com/ 

Moscow Times - http://www.themoscowtimes.com/ 

National Post and CP - http://www.canada.com/ 

New Straits Times (Kuala Lumpur) - http://www.emedia.com.my/Current_News/NST/ 
PETRA (Jordanian News Agency) - http://www.petra.gov.jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://www.philstar.com/philstar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://www.therussianissues.com/ 

Russian Observer - http://www.russianobserver.com/ 



SABA (The News Agency of Yemen) - http://www.sabanews.gov.ye 
Saudi Gazette - http://www.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://www.dispatch.co.za/ 

Sydney Morning Herald - http://www.smh.com.au 
Tehran Times - http://www.tehrantimes.com/ 

Times of India - http://timesofindia.indiatimes.com/cms.dll 
UNHCR UN High Commissioner on Refugees - http://www.unhcr.ch/ 
Ummah News - http://www.uxnmahnews.com/ 

Uzbekistan Report - http://www.uzreport.com/eng/ 

Washington Post - http://www.washingtonpost.com/ 

XinHuaNews Service - http://www.xinhuanet.com/english/ 

Yemen Times (weekly) - http://www.yementimes.com/ 

Yomiuri Shimbun (Japan) - http://www.yomiuri.co.jp/ 
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1.2.2 Supported Projects 

IDW-S is an FBI enterprise program/system and utilizes data feeds from several FBI (and other 
agency) programs. 
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